Lost mobile device notification apparatus and method for an autonomous vehicle

ABSTRACT

A notification apparatus and system are provided for a lost mobile device. After a notification is provided to indicate that a mobile device is still in an autonomous vehicle after arrival at a destination, user input is received for causing the autonomous vehicle to move toward, or remain within a predetermined distance from, a location of a user using a camera of the autonomous vehicle.

RELATED APPLICATIONS

The present application is a continuation of, and claims priority toU.S. patent application Ser. No. 16/679,192, titled “SYSTEM AND METHODFOR PROVIDING A NOTIFICATION THAT A MOBILE DEVICE IS STILL IN ANAUTONOMOUS VEHICLE AFTER DETECTING AN ARRIVAL AT A DESTINATION,” filedNov. 9, 2019, which is herein incorporated by reference in its entiretyfor all purposes.

FIELD OF THE INVENTION

The present invention relates to vehicles, and more particularly toautonomous vehicles.

BACKGROUND

Right now, autonomous vehicles are becoming more and more relevant. Aswe start using autonomous vehicles to transport people to differentplaces, problems might occur without any driver. For example, peoplemight leave their phones in the autonomous vehicle and have no humans togive it back.

There is thus a need for addressing these and/or other issues associatedwith the prior art.

SUMMARY

Under the user's instruction, an autonomous vehicle travels to aselected location. The user chooses a place to arrive at thedestination. After the arrival of the autonomous vehicle, it isdetermined whether the user's or third party's mobile device is still inthe vehicle. If the mobile device is still in the vehicle, the vehiclewill notify the user or third party in one or more ways to come back andget their mobile device.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 illustrates an autonomous vehicle system 1, in accordance withone embodiment.

FIG. 2A illustrates a method 200 for operating the autonomous vehiclesystem 1 of FIG. 1 , in accordance with one embodiment.

FIG. 2B illustrates a continuation of the method 200 shown in FIG. 2A,in accordance with one embodiment.

FIG. 2C illustrates a continuation of the method 200 shown in FIGS.2A-2B, in accordance with one embodiment.

FIG. 3A illustrates an exemplary user interface, in accordance with oneembodiment.

FIG. 3B illustrates another exemplary user interface, in accordance withone embodiment.

FIG. 3C illustrates another exemplary user interface, in accordance withone embodiment.

FIG. 3D illustrates another exemplary user interface, in accordance withone embodiment.

DETAILED DESCRIPTION

FIG. 1 illustrates an autonomous vehicle system 1, in accordance withone embodiment.

As shown in FIG. 1 , provided is a vehicle 10 that includes a processor12 connected to a power source 14, an automated driving controller 16,memory 18, a display 20, a network interface 28 for wirelesslycommunicating with a network 30, one or more speaker(s) 26, a camera 27,and an automated door lock 22.

In one embodiment, the automated driving controller 16 may controlvarious functions of the vehicle 10 including unillustrated brakes,steering wheel, etc. As shown in FIG. 1 , the display 20 is located in afront/middle portion of a dashboard unit (not shown) so it can beaccessed by all parties in the self driving vehicle 10. In oneembodiment, the power source 14 may be a rechargeable battery that ischarged by another power source. Further, one or more of the cameras 27may located on every door for facial recognition purposes. Similarly,the automated door lock 22 may be on every door for automaticallylocking and unlocking each door.

As shown in FIG. 1 , the memory 18 may be a hard drive, solid statememory, or any other kind of memory in the autonomous vehicle 10 forstoring any information needed for the autonomous 10 vehicle to operate.Further, the speakers 26 may be located in every interior and/orexterior corner of the autonomous vehicle 10. Still yet, the networkinterface 28 may be connected to the network 30 which can provide acommunication pathway to a food delivery server 33 and an automateddriving system server 32.

As further shown in FIG. 1 , a user phone 34 may be connected to thenetwork 30 to allow communication with all of the components shown inFIG. 1 (e.g. the vehicle 10, a third party phone 36, the food deliveryserver 33, the automated driving system server 32, etc.). The user phone34 may include multiple applications (e.g. an autonomous vehicleapplication, a food delivery application, a calendar application, etc.)for communicating with the various components above.

FIG. 2A illustrates a method 200 for operating the autonomous vehiclesystem 1 of FIG. 1 , in accordance with one embodiment.

As shown in operation 201, a user opens the autonomous vehicleapplication. In one embodiment, the user can do this by downloading theautonomous vehicle application at an on-line store, and launching it byselecting an icon associated with the application. In anotherembodiment, the user can access the autonomous vehicle application usinga website on a network browser. The contents of the network browser hasa similar appearance to the autonomous vehicle application, but insteadof downloading the autonomous vehicle application, the user accesses theautonomous vehicle application on the network browser. The web site maybe built using HTML 5.

In operation 202, the autonomous vehicle application receivesinformation from the memory 18, phone memory, or one of the servers 32,33, etc. that is stored by the one or more applications mentionedearlier. For example, information may be received that is stored by acalendar application. As another example, information may be receivedthat is stored by a calendar application that is capable of schedulingevents with third parties so the user and/or the third parties candecide who they want to pick up, where they want to go, and when theywant to go, using the autonomous vehicle system 1. In variousembodiments, examples of the calendar application may include iPHONE™calendar, GOOGLE™ calendar, etc.

In another embodiment, the autonomous vehicle application also receivesinformation from the memory 18, phone memory, or one of the servers 32,33, etc. that is stored by other applications. For example, informationmay be received that is stored by a social media or messagingapplication that is capable of tracking the location of third partiesassociated with the user, using global positioning system (GPS) systemcomponents of phones of the third parties. In various embodiments,examples of the social media or messaging application may includeINSTAGRAM™, FACEBOOK™ messenger, etc. In one embodiment, the thirdparties may be associated with the user, by being connected to them associal media “friends” or having contact information of the thirdparties stored in the memory 18, phone memory, or one of the servers 32,33, etc.

In yet another embodiment, the autonomous vehicle application alsoreceives information from the memory 18, phone memory, or one of theservers 32, 33, etc. that is stored by other applications. For example,information may be received that is stored by a food deliveryapplication that is capable of storing food purchase profiles that eachinclude a date of purchase, who made the purchase, a name and a locationof the restaurant that was contacted in the past, what food waspurchased and statistics on what food was purchased the most, etc. Suchinformation may be retrieved for the user and/or any third parties byaccessing the user phone 34, any third party phone 36, or the fooddelivery server 33 that communicates with the food delivery application.In various embodiments, examples of the food delivery application mayinclude UBEREATS™, DOORDASH™, etc.

In decision 203, it is determined whether there are any upcoming,relevant calendar events. In one embodiment, the information from thememory 18, phone memory, or one of the servers 32, 33, etc. that isstored by the calendar application (and received in operation 202) isanalyzed. For example, a date or time associated with a calendared eventmay be compared with the current time. If such date or time is within acertain threshold amount (e.g. 1 hour, 2 hours, 3 hours, etc.) of thecurrent date or time, the event may be determined to be relevant.

In another embodiment, the information from the memory 18, phone memory,or one of the servers 32, 33, etc. that is stored by the calendarapplication (and received in operation 202) may be further analyzed. Forexample, a location that is associated with a calendared event may becompared with an area where the user lives (physical address), or GPSlocation of the user phone 34 or any relevant third party phone. If thelocation is within a certain distance (e.g. 10 mi, 20 mi, 40 mi, 60 mi,etc.) of any of the above, the event may be determined to be relevant.

If it is determined that there is an upcoming, relevant calendar event,then, in operation 204, the autonomous vehicle application, using theinformation just acquired, may suggest the identified upcoming, relevantcalendar event(s). See user interface 301 of FIG. 3A.

In decision 205, it is determined whether the user chooses one of theupcoming, relevant calendar events suggested in operation 204. If it isdetermined in decision 205 that the user chooses one of the upcoming,relevant calendar events that are suggested in operation 204, theautonomous vehicle application automatically enters the destinationaddress of the chosen suggested upcoming, relevant calendar event, usingthe location information stored in the memory 18, phone memory, or oneof the servers 32, 33, etc. by the calendar application. See operation207.

If it is determined in decision 205 that the user does not choose one ofthe upcoming, relevant calendar events that is suggested in operation204, then the system may allow manual entry in operation 206. Inoperation 206, the user is permitted to enter the address manually andpress enter, for sending the manually-entered address to the automateddriving system server 32 that cooperates with the autonomous vehicleapplication on the user phone 34.

If it is determined in decision 205 that the user does choose one of theupcoming, relevant calendar events that is suggested in operation 204,then the application uses the destination of the calendar event that theuser picked and locates the corresponding street address (if necessary)and sends it to the automated driving system server 32 using the network30. In one embodiment, the method 200 reserves the autonomous vehicle 10even thought the method 200 may continue as follows (with the user notbeing ready to depart), so that the autonomous vehicle 10 can start itstravel toward the user while the user continues interacting with theautonomous vehicle application, in the manner set forth below.

In decision 208, the autonomous vehicle application determines if thereare any third parties to attend the upcoming relevant event that waschosen in operation 207, so that such third parties may be suggested forpick up by the autonomous vehicle 10 while in route to the destination.Specifically, the autonomous vehicle application may analyze theinformation from the calendar application and determine which thirdparties, if any, are scheduled to attend the event that is suggested inoperation 204 and selected in operation 207.

In one embodiment, if there is any third party identified for thesuggested/selected event, the autonomous vehicle application may receiveinformation from the messaging and/or social media application todetermine where the third party is currently residing. Using suchinformation just recently gathered, the autonomous vehicle applicationmay determine if it is possible/feasible to pick up the third partywhile in route to the destination. For example, the autonomous vehicleapplication may compare the event location (from the information fromthe memory 18, phone memory, or one of the servers 32, 33, etc. that isstored by the calendar application), with the location where the thirdparty resides (physical address), or GPS location of the mobile (e.g. 10mi, 20 mi, 40 mi, 60 mi, etc.) of the user, the event location, and/or apresent location of an available autonomous vehicle; it may be suggestedin operation 209 that such third party should be picked up. In anotherembodiment, operation 209 may require, before such suggestion, that thethird party be between the location of the user and the location of thesuggested/selected event (address).

As shown, if, in decision 208, the autonomous vehicle applicationdetermines that there are not any third parties to suggest to pick up,the autonomous vehicle application may simply request the autonomousvehicle to pick up the user at the user's current location, in operation2014 (shown in FIG. 2B).

If, on the other hand, in decision 208, the autonomous vehicleapplication determines that there are any third parties to suggest topick up, such third party pick up may be suggested, in operation 209.See, for example, user interface 302 of FIG. 3B.

In decision 2010, it is determined whether the user chooses one or moreof the suggested third parties for pickup. If it is determined indecision 2010 that the user does not choose one or more of the suggestedthird parties for pickup, the autonomous vehicle application may simplyrequest the autonomous vehicle 10 to pick up the user at the user'scurrent location, in operation 2014 (shown in FIG. 2B). If it isdetermined in decision 2010 that the user does choose one or more of thesuggested third parties for pickup, a request is sent to the thirdparty(ies) for permission to get picked up. See operation 2011. In oneembodiment, the autonomous vehicle application initiates a message thatis sent to the third party phone 36 so that the request is displayed onthe third party phone 36. See, for example, user interface 303 of FIG.3C.

In decision 2012, it is determined whether the third party accepts therequest sent in operation 2011. If it is determined that the third partydoes not accept the request sent in operation 2011, the autonomousvehicle application may simply request the autonomous vehicle to pick upthe user at the user's current location, in operation 2014 (shown inFIG. 2B). If, on the other hand, it is determined that the third partydoes accept the request sent in operation 2011, the autonomous vehicleapplication enters the current location of the third party to arrangepick up of both the user and the third party before arriving at thedestination identified in the calendar event. See operation 2013.

In one embodiment, the third party could be between the autonomousvehicle and the user so the third party could be picked up first. Inanother embodiment, the user could be between the autonomous vehicle andthe third party so the user could be picked up first.

FIG. 2B illustrates a continuation of the method 200 shown in FIG. 2A,in accordance with one embodiment.

In operation 2014, the vehicle is requested by the autonomous vehicleapplication to come to the location of the user or the third party,depending on which is closer. In one embodiment, the autonomous vehicleapplication sends a signal to a server which commands the autonomousvehicle 10 to drive to the appropriate location.

In operation 2015, the user and/or third party are notified that theautonomous vehicle is coming. In one embodiment, the autonomous vehicleapplication sends a message or notification to the user and/or thirdparty mobile devices 34, 36 so that they can see the message ornotification and are notified.

In decision 2016, it is determined whether the autonomous vehicle 10 hasarrived. In one embodiment, this may be accomplished by comparing thelocation of the autonomous vehicle 10 and the location of the userand/or third party mobile device 34, 36. If it is determined that theautonomous vehicle 10 has not arrived, the decision 2016 polls.

If, on the other hand, it is determined that the autonomous vehicle 10has arrived, the user and/or third party is authenticated in operation2017 before a door of the autonomous vehicle 10 is automatically openedfor the user and/or third party, using the automatic door lock 22. Inone embodiment, this authentication prevents another person from takingthe autonomous vehicle 10.

In one embodiment, this authentication of operation 2017 can beaccomplished using facial recognition. For example, the user and/orthird party may be required to provide a profile picture to theautomated driving system server 32 via the appropriate phone 34, 36, sothat such picture may be compared to a face of the user and/or thirdparty that is taken by using the camera 27 of the autonomous vehicle 10.As another example, if a profile picture is not used, the autonomousvehicle 10 may use photos from social media and/or photos stored on theuser's mobile device 32 to recognize the face of the user and/or thirdparty when being picked up by the autonomous vehicle 10.

In another embodiment, this authentication of operation 2017 can beaccomplished using location information. For example, a GPS-determinedlocation of the autonomous vehicle 10 can be compared to aGPS-determined location of the mobile device of the user and/or thirdparty 32, 34.

In yet another embodiment, the authentication of operation 2017 can beaccomplished using wireless connectivity. For example, it may bedetermined whether short range wireless connectivity (e.g. Bluetooth,etc.) exists between the autonomous vehicle 10 and the mobile device ofthe user and/or third party 32, 34. Specifically, if a short rangewireless connection is established between the autonomous vehicle 10 andthe mobile device of the user and/or third party 32, 34, an exchange ofinformation may be used to determine that the user and/or third party isat the location of the autonomous vehicle 10.

In any case, if it is determined that the autonomous vehicle has arrivedand the user and/or third party is authenticated by any or more or allof the methods described above in operation 2017, the autonomous vehicle10 automatically opens a door of the autonomous vehicle 10 for the userand/or third party, using the appropriate automated door lock 22.

As an option, if the autonomous vehicle 10, through its camera(s) 27observes that there are two people (e.g. the third party and user are ontwo sides of the autonomous vehicle) the autonomous vehicle 10 opens twodoors at once to let the user and third party in. If the user and thirdparty are observed to entry on one side of the autonomous vehicle 10(e.g. there was a curb on only one side) the autonomous vehicleapplication could notify the user that there was a curb on one side andopen only one door (e.g. one on the side of the curb) so that the userand/or third party does not attempt to enter on the side of theautonomous vehicle 10 where traffic is active.

In decision 2018, it is determined whether there are more parties topickup. If it is determined that there are more parties to pickup indecision 2018, operations 2016-2017 are repeated. If it is determinedthat there are no more parties to pickup, the autonomous vehicleapplication determines whether food is required at the destination perdecision 2021.

In one embodiment, the autonomous vehicle application determines whetherfood is required at the destination in decision 2021, by reviewing textin the calendar information received in operation 202 to determine iffood is necessary. For example, the autonomous vehicle application mayanalyze the calendar information to search for words such as “food,”“breakfast,” “lunch,” “dinner,” etc.

In another embodiment, the autonomous vehicle application determineswhether food is required at the destination in decision 2021, byreviewing a current time. If the current time is within standard timeframes associated with breakfast, lunch, dinner, etc., it may bedetermined that that food is required in decision 2021.

If, in decision 2021, the autonomous vehicle application determines thatit is time to eat, it is then determined whether there are any relevantrestaurants within a predetermined distance from the destination and/orroute to the destination. If it is determined that there are anyrelevant restaurants within the predetermined distance from thedestination and/or route to the destination, the autonomous vehicleapplication may send a request to the user and/or third parties todetermine if they want to eat at the destination per operation 2019. Inone embodiment, the request may simply present all of the relevantrestaurants within the predetermined distance from the destinationand/or route to the destination.

In one embodiment, the autonomous vehicle application may analyze theuser's and/or third parties' profiles from their food deliveryapplication, and then makes suggestions based on various criteria. Forexample, the autonomous vehicle application may compare the deliverytime of all the above described restaurants and the time frame of theevent. For example, if one restaurant can deliver food at 7:00 and theevent is from 1:00 to 5:00 then that restaurant would not be a suitablechoice.

As another example, the autonomous vehicle application may compare thedistance of the delivery area of the restaurants with the location atthe calendared event takes place. If the restaurant is within apredetermined distance (e.g. on the same block of the event, etc.), forexample, the autonomous vehicle application may decide that such be asuitable restaurant.

As yet another example, the autonomous vehicle application may inspectthe user's and the third parties' food delivery application profiles andidentify places where the user and/or third parties shop the most. Forexample, if the user likes Burger King™ and PF Chang's™ and the thirdparties like PF Chang's™ and Wendy's™, the autonomous vehicleapplication may suggest PF Chang's™. The autonomous vehicle applicationmay do the same for other people who are going to the event (other thanthe user and/or third parties).

Then, the autonomous vehicle application may present, using theinformation just gathered, the food that may be ordered. In decision2020, the user and/or third party may be given the opportunity to orderthe food just presented. If the user and/or third party do not order thefood, the method 200 continues in FIG. 2C. If, on the other hand, thefood is ordered, the user and/or third party may be notified that foodis coming per operation 2022 via the mobile devices 34, 36.

FIG. 2C illustrates a continuation of the method 200 shown in FIGS.2A-2B, in accordance with one embodiment.

As shown, it is determined, in decision 2023, by the autonomous vehicleapplication whether the autonomous vehicle 10 has almost arrived at thedestination. If it is determined that the autonomous vehicle 10 has notarrived in decision 2023, the decision 2023 polls. If, on the otherhand, the autonomous vehicle 10 has arrived, operation 2024 isperformed.

In operation 2024, the autonomous vehicle application displays amagnified map of the location were the autonomous vehicle 10 can park(e.g. parking lot, street parking spots, curb, etc.). In one embodiment,the autonomous vehicle application displays to the user aselectable/movable colored pin on the map so that the user may place thepin at a point where the automobile vehicle 10 should park.

In another embodiment, sensors of the autonomous vehicle 10 (or evensensors of other vehicles) may automatically identify open parking spotsand communicate such information to the autonomous vehicle applicationfor display on the map, so that the open parking spots may be selectedvia the map, without having to look out the window of the autonomousvehicle 10. See interface 304 of FIG. 3D.

The autonomous vehicle 10 may also display the map of parking spaces onthe display 20. The user and/or third parties may also point where theywant to park, for example, using voice control. For example, the userand/or third parties could say “park over by the bank” and autonomousvehicle 10 may park in a spot open near the bank. Regardless as to howthe user inputs a desired parking spot, in operation 2025, theautonomous vehicle 10 may receive the user-specified spot to park fromthe autonomous vehicle application.

In operation 2026, the autonomous vehicle 10 may park at the selectedlocation and may automatically open the door where it is best to exit.In one embodiment, the sensors of the autonomous vehicle 10 may detectwhich side of the autonomous vehicle 10 is safe for exit. It may do thisby receiving information from the exterior cameras 24 (e.g. their is anobstacle right next to where the autonomous vehicle 10 parked so theautonomous vehicle application may send the user a notification thatthey can not exit on the side of the obstacle).

In decision 2027, the autonomous vehicle 10 may determine whether theuser's phone 34 is still in the autonomous vehicle 10 after drop off. Inone embodiment, the autonomous vehicle 10 may determine whether theuser's phone 34 is in the autonomous vehicle 10 by comparing locationcoordinates from the GPS of autonomous vehicle 10, and locationcoordinates from the GPS of the user's phone 34 (or phone 36). Inanother embodiment, the autonomous vehicle 10 determines if a wirelessconnection still exists between the autonomous vehicle 10 and the user'sphone 34. In another embodiment, the autonomous vehicle applicationcould send the user's phone 34 a request asking if the user left theuser's phone 34 in the autonomous vehicle 10. The user may have thechoice to say “yes,” but if the user does not answer in a certain amountof time, then it may be decided that the user left his or her phone inthe autonomous vehicle 10. If the user did not leave his or her phone inthe autonomous vehicle 10, operations 2028-2029 may be skipped. If theuser did leave his or her phone in the autonomous vehicle 10, the method200 progresses to operation 2028.

In operation 2028, the autonomous vehicle 10 notifies the user that theyleft their phone in the autonomous vehicle 10. In one embodiment, theautonomous vehicle 10 may send an audible message through an externalautonomous vehicle speaker that audibly indicates that the user left thephone (e.g. “NAMEX, you left your phone in the autonomous vehicle”). Inanother embodiment, the autonomous vehicle 10 may send a photo of theuser's phone 34, showing that it is still in the autonomous vehicle 10to the third party's device 36. The autonomous vehicle 10 may use theinterior camera 27 to do this. As an option, object recognition may beused to determine which photograph (from multiple interior cameras) tosend (i.e. send the photograph with a phone recognized in it). Inanother embodiment, the autonomous vehicle 10 may send a photograph ofthe user's phone 34 (still in the autonomous vehicle 10) to the thirdparty's device 36.

In another embodiment, the autonomous vehicle 10 may send an instantmessage to one of the third party's device 36 saying that the user lefthis or her phone in the autonomous vehicle 10. In another embodiment,the autonomous vehicle 10 may physically follow the user until the userrealizes that they lost their phone. Such feature may use the exteriorcameras and GPS of the third party's device 36. For example, locationcoordinates from the GPS of the third party's device 36 may berepeatedly entered into the navigation system of the autonomous vehicle10 as the location coordinates change, so that the autonomous vehicle 10can follow the user who is presumably still with the third party.

In decision 2029, the autonomous vehicle 10 determines whether theuser's phone 34 is extracted using any of the techniques disclosedabove. If extraction is confirmed, the autonomous vehicle 10 may be usedby other parties. See operation 2030.

More illustrative information will now be set forth regarding variousoptional architectures and uses in which the foregoing method may or maynot be implemented, per the desires of the user. It should be stronglynoted that the following information is set forth for illustrativepurposes and should not be construed as limiting in any manner. Any ofthe following features may be optionally incorporated with or withoutthe exclusion of other features described.

In one embodiment, a system is provided, comprising: an autonomousvehicle configured to travel from an origin to a destination, inresponse to a user instruction; and an application including one or moreprograms, wherein the one or more programs are to be executed by one ormore processors of a mobile device of a user, the one or more programsincluding instructions for: receiving user input of the user; inresponse to receipt of the user input, causing transmission of the userinstruction; detecting arrival at the destination; after detectingarrival at the destination, determining whether the mobile device isstill in the autonomous vehicle; and in response to determining that themobile device is still in the autonomous vehicle after detecting thearrival at the destination, causing transmission of a signal to at leastone device that is not the mobile device, for providing a notificationthat the mobile device is still in the autonomous vehicle afterdetecting the arrival at the destination.

In another embodiment, a non-transitory computer readable storage mediumis provided storing one or more programs, the one or more programscomprising instructions which, when executed by a mobile device of auser, cause the mobile to: receive user input of the user; in responseto receipt of the user input, cause transmission of the user instructionfor use by an autonomous vehicle configured to travel from an origin toa destination in response to the user instruction; detect arrival at thedestination; after detecting arrival at the destination, determinewhether the mobile device is still in the autonomous vehicle; and inresponse to determining that the mobile device is still in theautonomous vehicle after detecting the arrival at the destination, causetransmission of a signal to at least one device that is not the mobiledevice, for providing a notification that the mobile device is still inthe autonomous vehicle after detecting the arrival at the destination.

In yet another embodiment, a method is provided, comprising: at a mobiledevice of a user: receiving user input of the user; in response toreceipt of the user input, causing transmission of the user instructionfor use by an autonomous vehicle configured to travel from an origin toa destination in response to the user instruction; detecting arrival atthe destination; after detecting arrival at the destination, determiningwhether the mobile device is still in the autonomous vehicle; and inresponse to determining that the mobile device is still in theautonomous vehicle after detecting the arrival at the destination,causing transmission of a signal to at least one device that is not themobile device, for providing a notification that the mobile device isstill in the autonomous vehicle after detecting the arrival at thedestination.

In one embodiment, the determining whether the mobile device is still inthe autonomous vehicle, includes comparing a global positioning system(GPS)-determined location of the autonomous vehicle and a GPS-determinedlocation of the mobile device.

In one embodiment, the determining whether the mobile device is still inthe autonomous vehicle, includes determining whether short rangewireless connectivity exists between the autonomous vehicle and themobile device.

In one embodiment, the determining whether the mobile device is still inthe autonomous vehicle, includes determining whether a message displayedvia the application that prompts additional user input, results in nofurther additional user input being detected.

In one embodiment, the transmission of the signal to at least one devicethat is not the mobile device, includes transmission of the signal to aspeaker of the autonomous vehicle, such that the notification is audiblein a proximity of the autonomous vehicle after detecting the arrival atthe destination. As an option, the speaker includes an interior speakerinside the autonomous vehicle. As another option, the speaker includesan exterior speaker of the autonomous vehicle.

In one embodiment, the transmission of the signal to at least one devicethat is not the mobile device, includes transmission of the signal to awireless network interface of the autonomous vehicle, such that thenotification is presented as a visual message.

In one embodiment, the at least one device includes another device ofthe user of the mobile device.

In one embodiment, the at least one device includes another mobiledevice of another person other than the user. As an option, the anothermobile device of the another person is identified, based on adetermination whether the another person accompanied the user in theautonomous vehicle. As another option, the determination whether theanother person accompanied the user in the autonomous vehicle is basedon a presence of the another person in the autonomous vehicle.

In one embodiment, after the notification that the mobile device isstill in the autonomous vehicle after detecting the arrival at thedestination, additional user input is received for causing theautonomous vehicle to remain in a proximity of the destination inresponse thereto.

In one embodiment, after the notification that the mobile device isstill in the autonomous vehicle after detecting the arrival at thedestination, additional user input is received for causing theautonomous vehicle to remain in a proximity of the user by tracking theuser using a camera of the autonomous vehicle.

In one embodiment, after the notification that the mobile device isstill in the autonomous vehicle after detecting the arrival at thedestination, additional user input is received for causing theautonomous vehicle to travel to an updated location indicated by theadditional user input.

In one embodiment, after the notification that the mobile device isstill in the autonomous vehicle after detecting the arrival at thedestination, additional user input is received for causing theautonomous vehicle to travel to a location of another mobile device.

In one embodiment, after the notification that the mobile device isstill in the autonomous vehicle after detecting the arrival at thedestination, additional user input is received for causing theautonomous vehicle to travel to a location of another mobile device ofanother person who accompanied the user in the autonomous vehicle.

It is noted that the techniques described herein, in an aspect, areembodied in executable instructions stored in a computer readable mediumfor use by or in connection with an instruction execution machine,apparatus, or device, such as a computer-based or processor-containingmachine, apparatus, or device. It will be appreciated by those skilledin the art that for some embodiments, other types of computer readablemedia are included which may store data that is accessible by acomputer, such as magnetic cassettes, flash memory cards, digital videodisks, Bernoulli cartridges, random access memory (RAM), read-onlymemory (ROM), and the like.

As used here, a “computer-readable medium” includes one or more of anysuitable media for storing the executable instructions of a computerprogram such that the instruction execution machine, system, apparatus,or device may read (or fetch) the instructions from the computerreadable medium and execute the instructions for carrying out thedescribed methods. Suitable storage formats include one or more of anelectronic, magnetic, optical, and electromagnetic format. Anon-exhaustive list of conventional exemplary computer readable mediumincludes: a portable computer diskette; a RAM; a ROM; an erasableprogrammable read only memory (EPROM or flash memory); optical storagedevices, including a portable compact disc (CD), a portable digitalvideo disc (DVD), a high definition DVD (HD-DVD™), a BLU-RAY disc; andthe like.

It should be understood that the arrangement of components illustratedin the Figures described are exemplary and that other arrangements arepossible. It should also be understood that the various systemcomponents (and means) defined by the claims, described below, andillustrated in the various block diagrams represent logical componentsin some systems configured according to the subject matter disclosedherein.

For example, one or more of these system components (and means) may berealized, in whole or in part, by at least some of the componentsillustrated in the arrangements illustrated in the described Figures. Inaddition, while at least one of these components are implemented atleast partially as an electronic hardware component, and thereforeconstitutes a machine, the other components may be implemented insoftware that when included in an execution environment constitutes amachine, hardware, or a combination of software and hardware.

More particularly, at least one component defined by the claims isimplemented at least partially as an electronic hardware component, suchas an instruction execution machine (e.g., a processor-based orprocessor-containing machine) and/or as specialized circuits orcircuitry (e.g., discreet logic gates interconnected to perform aspecialized function). Other components may be implemented in software,hardware, or a combination of software and hardware. Moreover, some orall of these other components may be combined, some may be omittedaltogether, and additional components may be added while still achievingthe functionality described herein. Thus, the subject matter describedherein may be embodied in many different variations, and all suchvariations are contemplated to be within the scope of what is claimed.

In the description above, the subject matter is described with referenceto acts and symbolic representations of operations that are performed byone or more devices, unless indicated otherwise. As such, it will beunderstood that such acts and operations, which are at times referred toas being computer-executed, include the manipulation by the processor ofdata in a structured form. This manipulation transforms the data ormaintains it at locations in the memory system of the computer, whichreconfigures or otherwise alters the operation of the device in a mannerwell understood by those skilled in the art. The data is maintained atphysical locations of the memory as data structures that have particularproperties defined by the format of the data. However, while the subjectmatter is being described in the foregoing context, it is not meant tobe limiting as those of skill in the art will appreciate that various ofthe acts and operations described hereinafter may also be implemented inhardware.

To facilitate an understanding of the subject matter described herein,many aspects are described in terms of sequences of actions. At leastone of these aspects defined by the claims is performed by an electronichardware component. For example, it will be recognized that the variousactions may be performed by specialized circuits or circuitry, byprogram instructions being executed by one or more processors, or by acombination of both. The description herein of any sequence of actionsis not intended to imply that the specific order described forperforming that sequence must be followed. All methods described hereinmay be performed in any suitable order unless otherwise indicated hereinor otherwise clearly contradicted by context

The use of the terms “a” and “an” and “the” and similar referents in thecontext of describing the subject matter (particularly in the context ofthe following claims) are to be construed to cover both the singular andthe plural, unless otherwise indicated herein or clearly contradicted bycontext. Recitation of ranges of values herein are merely intended toserve as a shorthand method of referring individually to each separatevalue falling within the range, unless otherwise indicated herein, andeach separate value is incorporated into the specification as if it wereindividually recited herein. Furthermore, the foregoing description isfor the purpose of illustration only, and not for the purpose oflimitation, as the scope of protection sought is defined by the claimsas set forth hereinafter together with any equivalents thereof entitledto. The use of any and all examples, or exemplary language (e.g., “suchas”) provided herein, is intended merely to better illustrate thesubject matter and does not pose a limitation on the scope of thesubject matter unless otherwise claimed. The use of the term “based on”and other like phrases indicating a condition for bringing about aresult, both in the claims and in the written description, is notintended to foreclose any other conditions that bring about that result.No language in the specification should be construed as indicating anynon-claimed element as essential to the practice of the invention asclaimed.

The embodiments described herein included the one or more modes known tothe inventor for carrying out the claimed subject matter. Of course,variations of those embodiments will become apparent to those ofordinary skill in the art upon reading the foregoing description. Theinventor expects skilled artisans to employ such variations asappropriate, and the inventor intends for the claimed subject matter tobe practiced otherwise than as specifically described herein.Accordingly, this claimed subject matter includes all modifications andequivalents of the subject matter recited in the claims appended heretoas permitted by applicable law. Moreover, any combination of theabove-described elements in all possible variations thereof isencompassed unless otherwise indicated herein or otherwise clearlycontradicted by context.

What is claimed is:
 1. A system, comprising: an autonomous vehicleconfigured to travel from an origin to a destination, in response to auser instruction; and an application including one or more programs,wherein the one or more programs are to be executed by one or moreprocessors of a mobile device of a user, the one or more programsincluding instructions for: receiving user input of the user; inresponse to receipt of the user input, causing transmission of the userinstruction; detecting arrival at the destination; after detectingarrival at the destination, determining whether the mobile device isstill in the autonomous vehicle; and in response to determining that themobile device is still in the autonomous vehicle after detecting thearrival at the destination, causing transmission of a signal to at leastone device that is not the mobile device, for providing a notificationthat the mobile device is still in the autonomous vehicle afterdetecting the arrival at the destination, where, after the notificationthat the mobile device is still in the autonomous vehicle afterdetecting the arrival at the destination, additional user input isreceived for causing the autonomous vehicle to move toward, or remainwithin a predetermined distance from, a location of the user using acamera of the autonomous vehicle.
 2. The system of claim 1, wherein thedetermining whether the mobile device is still in the autonomousvehicle, includes comparing a global positioning system (GPS)-determinedlocation of the autonomous vehicle and a GPS-determined location of themobile device.
 3. The system of claim 1, wherein the determining whetherthe mobile device is still in the autonomous vehicle, includesdetermining whether short range wireless connectivity exists between theautonomous vehicle and the mobile device.
 4. The system of claim 1,wherein the determining whether the mobile device is still in theautonomous vehicle, includes determining whether a message displayed viathe application that prompts additional user input, results in theadditional user input not being detected.
 5. The system of claim 1,wherein the transmission of the signal to at least one device that isnot the mobile device, includes transmission of the signal to a speakerof the autonomous vehicle, such that the notification is audible withina predetermined distance from the autonomous vehicle after detecting thearrival at the destination.
 6. The system of claim 5, wherein thespeaker includes an interior speaker inside the autonomous vehicle. 7.The system of claim 5, wherein the speaker includes an exterior speakerof the autonomous vehicle.
 8. The system of claim 1, wherein thetransmission of the signal to at least one device that is not the mobiledevice, includes transmission of the signal to a wireless networkinterface of the autonomous vehicle, such that the notification ispresented as a visual message.
 9. The system of claim 1, wherein the atleast one device includes another device of the user of the mobiledevice.
 10. The system of claim 1, wherein the at least one deviceincludes another mobile device of another person other than the user.11. The system of claim 10, wherein the another mobile device of theanother person is identified, based on a determination whether theanother person accompanied the user in the autonomous vehicle.
 12. Thesystem of claim 11, wherein the determination whether the another personaccompanied the user in the autonomous vehicle is based on a presence ofthe another person in the autonomous vehicle.
 13. The system of claim 1,wherein, after the notification that the mobile device is still in theautonomous vehicle after detecting the arrival at the destination,additional user input is received for causing the autonomous vehicle totravel to an updated location indicated by the additional user input.14. The system of claim 1, wherein, after the notification that themobile device is still in the autonomous vehicle after detecting thearrival at the destination, additional user input is received forcausing the autonomous vehicle to travel to a location of another mobiledevice.
 15. The system of claim 1, wherein, after the notification thatthe mobile device is still in the autonomous vehicle after detecting thearrival at the destination, additional user input is received forcausing the autonomous vehicle to travel to a location of another mobiledevice of another person who accompanied the user in the autonomousvehicle.
 16. The system of claim 1, wherein, after the notification thatthe mobile device is still in the autonomous vehicle after detecting thearrival at the destination, the additional user input is received forcausing the autonomous vehicle to move toward the location of the user.17. The system of claim 1, wherein, after the notification that themobile device is still in the autonomous vehicle after detecting thearrival at the destination, the additional user input is received forcausing the autonomous vehicle to remain within the predetermineddistance from the location of the user.
 18. A non-transitory computerreadable storage medium storing one or more programs, the one or moreprograms comprising instructions which, when executed by a mobile deviceof a user, cause the mobile device to: receive user input of the user;in response to receipt of the user input, cause transmission of the userinput for use by an autonomous vehicle configured to travel from anorigin to a destination in response to the user instruction; detectarrival at the destination; after detecting arrival at the destination,determine whether the mobile device is still in the autonomous vehicle;and in response to determining that the mobile device is still in theautonomous vehicle after detecting the arrival at the destination, causetransmission of a signal to at least one device that is not the mobiledevice, for providing a notification that the mobile device is still inthe autonomous vehicle after detecting the arrival at the destination,where, after the notification that the mobile device is still in theautonomous vehicle after detecting the arrival at the destination,additional user input is received for causing the autonomous vehicle tomove toward, or remain within a predetermined distance from, a locationof the user using a camera of the autonomous vehicle.
 19. A method,comprising: at a mobile device of a user: receiving user input of theuser; in response to receipt of the user input, causing transmission ofthe user input for use by an autonomous vehicle configured to travelfrom an origin to a destination in response to the user instruction;detecting arrival at the destination; after detecting arrival at thedestination, determining whether the mobile device is still in theautonomous vehicle; and in response to determining that the mobiledevice is still in the autonomous vehicle after detecting the arrival atthe destination, causing transmission of a signal to at least one devicethat is not the mobile device, for providing a notification that themobile device is still in the autonomous vehicle after detecting thearrival at the destination, where, after the notification that themobile device is still in the autonomous vehicle after detecting thearrival at the destination, additional user input is received forcausing the autonomous vehicle to move toward, or remain within apredetermined distance from, a location of the user using a camera ofthe autonomous vehicle.